Custom Report
1 Intoduction
This report is one of 493,845 that I will make, and one of 104,070,413 that could be made.
I “toke” the 1.4 TB Linked-In data that was breached in 2020, and turned it into some insights to power my job HUNT.
The insights I could share in this report, that are also related to my goals, are:
- Industry base recruitment trend.
- Company base workforce timeline.
- Current/part workforce info:
- Basic info: Name, job title, status, social link. I could add geo-location for some that have the data, but it would look creepy.
- Their work period.
- Their experiences.
2 About me
Salutations; I’m Joseph, a self-taught data analyst, engineer, and scraper.
Despite life’s challenges, my goal remains a remote job, either full or part-time, and having friends to tackle the challenges of this changing world with.
To show my skills and dedication, I made this project that yielded this tailored report.
3 About the project
3.1 How this project comes to life?
You would know by now, from my email, that I am hunting for a job.
About a year ago, I scraped contact info from Google Map to get my first job. Later I scraped contact from Linked-In website… you can check how that went in here.
Recently, I finally got to learning SQL because of DuckDB, it is a software that allows you to process big data in your local machine by using storage space as RAM; Then I remembered about a leaked Linked-In data that I couldn’t process.
Thus my journey started to learn SQL, process the data, and make something out of it.
3.2 The process
The process was done in my local machine, and it was as followed.
3.2.1 Downloaded the leaked data
I downloaded the data from a torrent.
There was around 700 .gz file, each is around 280 Mb; 196 GB in total.
Each .gz file contain a 2 GB file; 1.4 TB in total.
Each file have multiple lines, and each one of them is a JSON; Not the file is a JSON, it just have multiple JSONs, one in each line.
3.2.2 Processing the weird data
I this phase I created a script that automatically open an archive, process the file, and save it as a Parquet file with compression level of 22.
I used Python, Pathlib, Polars, and a lot of patience.
The process toke around 20 minutes per file, in total it toke around three weeks (I had to shutdown my PC at night) The result was 700 parquet files, each is around 190 Mb; 133 GB in total.
3.2.3 Making relational database
The data in the datasets were nested, especially the “experience” field, it had the experience of a person and the company info; The problem is that the company info get repeated multiple tiles, across all datasets.
Making a relational database will solve this, and make the exploratory data analysis easier.
The code was split in two:
1. I used Polars to split each of the 700 datasets into mini relational databases.
2. I used DuckDB to merge all the mini relational databases and remove duplicates in some, mainly company and university information’s.
The result was a relational database that is 73 GB in size; From 1.4 TB to 73 GB.
All of this is using my PC, so servers were harmed, only my CPU fan and my ear.
3.2.4 Filter
I filtered out companies base on their industry, country, and whether I have the email of one of the higher ups.
4 General graphs
4.1 market research indestry’s yearly new recruit count
4.2 metrixlab’s workforce status over the years
5 Workforce sample
5.1 Aditya Sinha
Job title: Client director
Associated: True
Socials: https://linkedin.com/in/aditya-sinha-46594215
5.1.1 Aditya Sinha’s working period at metrixlab
5.1.2 Gantt plot of Aditya Sinha’s experience
5.2 Alan Distassio
Job title: Research team leader - product innovation
Associated: True
Socials: https://linkedin.com/in/alandistassio
5.2.1 Alan Distassio’s working period at metrixlab
5.2.2 Gantt plot of Alan Distassio’s experience
5.3 Alexander Kleijngeld
Job title: Senior director, solution consultancy
Associated: True
Socials: https://linkedin.com/in/alexanderkleijngeld | https://linkedin.com/in/alexander-kleijngeld-67a22b1
5.3.1 Alexander Kleijngeld’s working period at metrixlab
5.3.2 Gantt plot of Alexander Kleijngeld’s experience
5.4 Anna Frano
Job title: Senior vice president, client partner
Associated: True
Socials: https://linkedin.com/in/anna-unger-frano-aa58363 | https://linkedin.com/in/anna-frano-aa58363
5.4.1 Anna Frano’s working period at metrixlab
5.4.2 Gantt plot of Anna Frano’s experience
5.5 Anthony Yuen
Job title: Associate director - team lead
Associated: True
Socials: https://linkedin.com/in/yuenanthony
5.5.1 Anthony Yuen’s working period at metrixlab
5.5.2 Gantt plot of Anthony Yuen’s experience
5.6 Arne Luteijn
Job title: Senior research manager | teamlead brand engagement
Associated: True
Socials: https://linkedin.com/in/arneluteijn
5.6.1 Arne Luteijn’s working period at metrixlab
5.6.2 Gantt plot of Arne Luteijn’s experience
5.7 Ashish Ubriani
Job title: Senior project manager
Associated: True
Socials: https://linkedin.com/in/ashish-ubriani-33a77414 | https://facebook.com/ashish.ubriani
5.7.1 Ashish Ubriani’s working period at metrixlab
5.7.2 Gantt plot of Ashish Ubriani’s experience
5.8 Barbara Du Perron
Job title: Director, global knowledge innovation consulting
Associated: True
Socials: https://linkedin.com/in/barbara-du-perron-1b0ba32 | https://facebook.com/barbara.duperron
5.8.1 Barbara Du Perron’s working period at metrixlab
5.8.2 Gantt plot of Barbara Du Perron’s experience
5.9 Benjamin Piper
Job title: Vice president
Associated: True
Socials: https://linkedin.com/in/benjamincpiper | https://linkedin.com/in/benjamin-piper-1b965 | https://facebook.com/ben.piper.3538 | https://klout.com/benjamincpiper | https://twitter.com/benjamincpiper
5.9.1 Benjamin Piper’s working period at metrixlab
5.9.2 Gantt plot of Benjamin Piper’s experience
5.10 Biswaroop Chatterjee
Job title: Director
Associated: True
Socials: https://linkedin.com/in/biswaroop-chatterjee-b67a4028
5.10.1 Biswaroop Chatterjee’s working period at metrixlab
5.10.2 Gantt plot of Biswaroop Chatterjee’s experience
5.11 Campbell Fitch
Job title: Global human resources director
Associated: False
Socials: https://linkedin.com/in/campbell-fitch-9512446
5.11.1 Campbell Fitch’s working period at metrixlab
5.11.2 Gantt plot of Campbell Fitch’s experience
5.12 Dan Campbell
Job title: Vp, brand engagement and innovation solutions
Associated: False
Socials: https://facebook.com/daniel.r.campbell | https://linkedin.com/in/dcampbellbrandresearch | https://linkedin.com/in/dancampbellny | https://linkedin.com/in/dan-campbell-49610a | https://linkedin.com/in/dancampbelladmeasurement | https://twitter.com/dsoupbone | https://angel.co/dan-campbell-2
5.12.1 Dan Campbell’s working period at metrixlab
5.12.2 Gantt plot of Dan Campbell’s experience
5.13 Dan Kent-Smith
Job title: Client director
Associated: True
Socials: https://linkedin.com/in/dan-kent-smith-a8352512 | https://linkedin.com/in/dankentsmith
5.13.1 Dan Kent-Smith’s working period at metrixlab
5.13.2 Gantt plot of Dan Kent-Smith’s experience
5.14 Edwin Van Der Harst
Job title: Client director
Associated: True
Socials: https://linkedin.com/in/edwin-van-der-harst-2b96781 | https://linkedin.com/in/edwinvanderharst
5.14.1 Edwin Van Der Harst’s working period at metrixlab
5.14.2 Gantt plot of Edwin Van Der Harst’s experience
5.15 Emanuele Carioti
Job title: Opinionista opionionbar.com - metrixlab nederland b v
Associated: False
Socials: https://twitter.com/emanuelecarioti | https://linkedin.com/in/emanuele-carioti-61333718 | https://facebook.com/emanuelecarioti
5.15.1 Emanuele Carioti’s working period at metrixlab
5.15.2 Gantt plot of Emanuele Carioti’s experience
5.16 Erika Roman
Job title: Senior research manager
Associated: True
Socials: https://linkedin.com/in/erikaroman
5.16.1 Erika Roman’s working period at metrixlab
5.16.2 Gantt plot of Erika Roman’s experience
5.17 Esther Heuvelman
Job title: Director methods and process
Associated: True
Socials: https://linkedin.com/in/esther-heuvelman-38b8907
5.17.1 Esther Heuvelman’s working period at metrixlab
5.17.2 Gantt plot of Esther Heuvelman’s experience
5.18 Eva Van Dueren Den Hollander
Job title: Stagiair
Associated: True
Socials: https://linkedin.com/in/eva-van-dueren-den-hollander-8066b1151
5.18.1 Eva Van Dueren Den Hollander’s working period at metrixlab
5.18.2 Gantt plot of Eva Van Dueren Den Hollander’s experience
5.19 Gayatri Srikant
Job title: Managing director
Associated: True
Socials: https://linkedin.com/in/gayatri-srikant-89658a20 | https://facebook.com/gayatri.srikant
5.19.1 Gayatri Srikant’s working period at metrixlab
5.19.2 Gantt plot of Gayatri Srikant’s experience
5.20 Gina Eckardt
Job title: Senior qualitative research manager
Associated: True
Socials: https://linkedin.com/in/gina-eckardt-5a253813
5.20.1 Gina Eckardt’s working period at metrixlab
5.20.2 Gantt plot of Gina Eckardt’s experience
5.21 Goutham Goli
Job title: ****
Associated: True
Socials: https://linkedin.com/in/goutham-goli-6a6616141
5.21.1 Goutham Goli’s working period at metrixlab
5.21.2 Gantt plot of Goutham Goli’s experience
5.22 Greg Bontempo
Job title: Senior project manager
Associated: True
Socials: https://linkedin.com/in/gregorybontempo
5.22.1 Greg Bontempo’s working period at metrixlab
5.22.2 Gantt plot of Greg Bontempo’s experience
5.23 Hans Van Lochem
Job title: Director
Associated: True
Socials: https://linkedin.com/in/hans-van-lochem-3996b75
5.23.1 Hans Van Lochem’s working period at metrixlab
5.23.2 Gantt plot of Hans Van Lochem’s experience
5.24 Hans Verhulst
Job title: Global human resources director
Associated: True
Socials: https://linkedin.com/in/hans-verhulst-4591b22 | https://twitter.com/hansverhulst | https://linkedin.com/in/hansverhulstgfk
5.24.1 Hans Verhulst’s working period at metrixlab
5.24.2 Gantt plot of Hans Verhulst’s experience
5.25 Helene Pavlidis
Job title: Vice president
Associated: True
Socials: https://linkedin.com/in/helenepavlidis
5.25.1 Helene Pavlidis’s working period at metrixlab
5.25.2 Gantt plot of Helene Pavlidis’s experience
5.26 Hilary Gaines
Job title: Senior director, global knowledge and innovation consultancy
Associated: True
Socials: https://linkedin.com/in/hilary-gaines-8708367
5.26.1 Hilary Gaines’s working period at metrixlab
5.26.2 Gantt plot of Hilary Gaines’s experience
5.27 Jan Philippa
Job title: Relationship director
Associated: True
Socials: https://linkedin.com/in/jan-philippa-0061972
5.27.1 Jan Philippa’s working period at metrixlab
5.27.2 Gantt plot of Jan Philippa’s experience
5.28 Jasen Holness
Job title: Senior vice president - agency and media practice
Associated: True
Socials: https://linkedin.com/in/jasen-holness-47944a28
5.28.1 Jasen Holness’s working period at metrixlab
5.28.2 Gantt plot of Jasen Holness’s experience
5.29 Jason Walker
Job title: Team leader - product innovation
Associated: True
Socials: https://linkedin.com/in/jason-walker-bbb4225
5.29.1 Jason Walker’s working period at metrixlab
5.29.2 Gantt plot of Jason Walker’s experience
5.30 Jay Pluhar
Job title: Executive vice president - global knowledge innovation consulting
Associated: True
Socials: https://linkedin.com/in/jay-pluhar-403297
5.30.1 Jay Pluhar’s working period at metrixlab
5.30.2 Gantt plot of Jay Pluhar’s experience
5.31 Kathy Relias
Job title: Regional vice president
Associated: False
Socials: https://linkedin.com/in/kathy-relias-9675913 | https://linkedin.com/in/kathleen-relias-9675913
5.31.1 Kathy Relias’s working period at metrixlab
5.31.2 Gantt plot of Kathy Relias’s experience
5.32 Lauren Geissler
Job title: Senior research manager
Associated: True
Socials: https://linkedin.com/in/lauren-geissler-aa710428
5.32.1 Lauren Geissler’s working period at metrixlab
5.32.2 Gantt plot of Lauren Geissler’s experience
5.33 Leandro Papone
Job title: Business development manager ebusiness research
Associated: True
Socials: https://linkedin.com/in/leandro-papone-3802ab2
5.33.1 Leandro Papone’s working period at metrixlab
5.33.2 Gantt plot of Leandro Papone’s experience
5.34 Marco Pasqualina
Job title: Sales leader | managing director | data and insights | enterprise technology | channel sales
Associated: False
Socials: https://linkedin.com/in/marcopasqualina | https://linkedin.com/in/marco-pasqualina-654565
5.34.1 Marco Pasqualina’s working period at metrixlab
5.34.2 Gantt plot of Marco Pasqualina’s experience
5.35 Margriet Brand
Job title: Senior research manager and teamleader product innovation
Associated: True
Socials: https://linkedin.com/in/margriet-brand-73219a6
5.35.1 Margriet Brand’s working period at metrixlab
5.35.2 Gantt plot of Margriet Brand’s experience
5.36 Marieke Sijbertsma-Meerbeek
Job title: Research manager and team leader media and advertising
Associated: False
Socials: https://linkedin.com/in/marieke-sijbertsma-meerbeek-b467227
5.36.1 Marieke Sijbertsma-Meerbeek’s working period at metrixlab
5.36.2 Gantt plot of Marieke Sijbertsma-Meerbeek’s experience
5.37 Marko Kalis
Job title: Team leader product innovation
Associated: True
Socials: https://facebook.com/markokalis | https://linkedin.com/in/markokalis
5.37.1 Marko Kalis’s working period at metrixlab
5.37.2 Gantt plot of Marko Kalis’s experience
5.38 Marla Wert
Job title: Vice president, client director
Associated: False
Socials: https://linkedin.com/in/marlawert
5.38.1 Marla Wert’s working period at metrixlab
5.38.2 Gantt plot of Marla Wert’s experience
5.39 Martin Ash
Job title: Group lead, entertainment sector
Associated: True
Socials: https://twitter.com/dynamicmarty | https://linkedin.com/in/martin-ash-56621329
5.39.1 Martin Ash’s working period at metrixlab
5.39.2 Gantt plot of Martin Ash’s experience
5.40 Maurits Moti
Job title: Client director
Associated: True
Socials: https://linkedin.com/in/maurits-moti | https://twitter.com/mauritsmoti | https://linkedin.com/in/maurits-moti-00442522
5.40.1 Maurits Moti’s working period at metrixlab
5.40.2 Gantt plot of Maurits Moti’s experience
5.41 Michele Mcdonald
Job title: Group senior vice president
Associated: True
Socials: https://linkedin.com/in/michelemcdonald
5.41.1 Michele Mcdonald’s working period at metrixlab
5.41.2 Gantt plot of Michele Mcdonald’s experience
5.42 Michelle De Montigny
Job title: Evp, us and global commercial strategy
Associated: True
Socials: https://facebook.com/michelle.demontigny | https://linkedin.com/in/michelle-de-montigny-91abb81
5.42.1 Michelle De Montigny’s working period at metrixlab
5.42.2 Gantt plot of Michelle De Montigny’s experience
5.43 Michelle O’Neill
Job title: Senior vice president, client strategy
Associated: False
Socials: https://linkedin.com/in/michelleoneill42
5.43.1 Michelle O’Neill’s working period at metrixlab
5.43.2 Gantt plot of Michelle O’Neill’s experience
5.44 Mike Nugent
Job title: Vice president, client director
Associated: True
Socials: https://linkedin.com/in/mike-nugent-815b3b3
5.44.1 Mike Nugent’s working period at metrixlab
5.44.2 Gantt plot of Mike Nugent’s experience
5.45 Mohammed Basha
Job title: Senior .human resources
Associated: True
Socials: https://linkedin.com/in/mohammed-khaleel-a3548420
5.45.1 Mohammed Basha’s working period at metrixlab
5.45.2 Gantt plot of Mohammed Basha’s experience
5.46 Monica Reed
Job title: Senior project manager and global sourcing
Associated: True
Socials: https://linkedin.com/in/reedmonica | https://linkedin.com/in/monica-reed-00788510
5.46.1 Monica Reed’s working period at metrixlab
5.46.2 Gantt plot of Monica Reed’s experience
5.47 Pieter Van Der Gouwe
Job title: Managing director at metrixlab
Associated: True
Socials: https://linkedin.com/in/ptvandergouwe | https://linkedin.com/in/pieter-van-der-gouwe-a2a2295
5.47.1 Pieter Van Der Gouwe’s working period at metrixlab
5.47.2 Gantt plot of Pieter Van Der Gouwe’s experience
5.48 Pim Van Leeuwen
Job title: Director of client strategy and growth
Associated: True
Socials: https://linkedin.com/in/pimleeuwen
5.48.1 Pim Van Leeuwen’s working period at metrixlab
5.48.2 Gantt plot of Pim Van Leeuwen’s experience
5.49 Robert Wilhelm
Job title: Board member and investor
Associated: False
Socials: https://linkedin.com/in/robertwilhelm | https://twitter.com/rpwilhelm | https://linkedin.com/in/robert-wilhelm-b01107 | https://facebook.com/robert.wilhelm.nl
5.49.1 Robert Wilhelm’s working period at metrixlab
5.49.2 Gantt plot of Robert Wilhelm’s experience
5.50 Samantha Muscia
Job title: Senior research manager and product innovation team leader
Associated: True
Socials: https://linkedin.com/in/samantha-muscia-82349a5b | https://facebook.com/samantha.muscia
5.50.1 Samantha Muscia’s working period at metrixlab
5.50.2 Gantt plot of Samantha Muscia’s experience
5.51 Samy Boudjedra
Job title: Senior vice president sales
Associated: True
Socials: https://linkedin.com/in/samy-boudjedra-2b791a4
5.51.1 Samy Boudjedra’s working period at metrixlab
5.51.2 Gantt plot of Samy Boudjedra’s experience
5.52 Sanne Handgraaf
Job title: Research manager product innovation
Associated: True
Socials: https://linkedin.com/in/shandgraaf
5.52.1 Sanne Handgraaf’s working period at metrixlab
5.52.2 Gantt plot of Sanne Handgraaf’s experience
5.53 Selin Varol
Job title: Senior research manager and social insights consultant
Associated: True
Socials: https://linkedin.com/in/svarol | https://linkedin.com/in/selin-varol-26379341
5.53.1 Selin Varol’s working period at metrixlab
5.53.2 Gantt plot of Selin Varol’s experience
5.54 Shireen Abad
Job title: Stagiair
Associated: True
Socials: https://linkedin.com/in/shireen-abad
5.54.1 Shireen Abad’s working period at metrixlab
5.54.2 Gantt plot of Shireen Abad’s experience
5.55 Thijs Elias
Job title: Director sales and marketing
Associated: True
Socials: https://linkedin.com/in/thijs-elias-6ab1b
5.55.1 Thijs Elias’s working period at metrixlab
5.55.2 Gantt plot of Thijs Elias’s experience
5.56 Thijs Elias
Job title: Chief executive officer at metrixlab and executive officer at macromill inc
Associated: True
Socials: https://linkedin.com/in/thijs-elias-440210
5.56.1 Thijs Elias’s working period at metrixlab
5.56.2 Gantt plot of Thijs Elias’s experience
5.57 Vinay Rao
Job title: Senior client director
Associated: True
Socials: https://linkedin.com/in/vinayraometrixlab | https://linkedin.com/in/vinay-rao-19703811
5.57.1 Vinay Rao’s working period at metrixlab
5.57.2 Gantt plot of Vinay Rao’s experience
5.58 Vincent Blaney
Job title: Managing director - australia and new zealand
Associated: True
Socials: https://linkedin.com/in/vincentblaney | https://linkedin.com/in/vincent-blaney-59a42016
5.58.1 Vincent Blaney’s working period at metrixlab
5.58.2 Gantt plot of Vincent Blaney’s experience
5.59 Vincent Borst
Job title: Client director
Associated: False
Socials: https://linkedin.com/in/vincent-borst-059844
5.59.1 Vincent Borst’s working period at metrixlab
5.59.2 Gantt plot of Vincent Borst’s experience
5.60 Walter Idema
Job title: Research manager npd and shopper research
Associated: True
Socials: https://linkedin.com/in/walter-idema-b2230b9